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SPECIFICATION 
DVD SUBPICTURE RENDERING WITHOUT LOSS OF COLOR RESOLUTION 

10 BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to the field of DVD (Digital Versatile Disk) 
technology. There are several types of DVD. This invention relates to DVD-video. 
More specifically, the present invention relates to the rendering of a DVD-video 
In v subpicture on a computer system without loss of color resolution. 

is? 

% - The Background 

L-5. 

fij DVD technology has grown in popularity in recent years. Many households now 

£20 own a DVD player next to their television sets. Even more dramatically, however, nearly 
^3 every computer sold now has a DVD-ROM player built into it. There are several 

problems that are encountered when attempting to play DVDs on a computer that are not 
encountered when attempting to play them on a traditional DVD player. 

25 When playing a DVD-video on a computer, it is necessary to convert the picture to 

one that not only can be displayed on a computer monitor, but also may be integrated in 
to the existing operating system being run. An operating system usually has a user 
interface containing one or more windows which may run different programs. When a 
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DVD is to be played on a computer, normally a new window must be open. However, 
other windows on the desktop may also be left open. Therefore, the video displayed in 
the DVD window must be of the same format (colors, resolution, etc.) as the rest of the 
desktop and the other windows in order to be properly displayed on the computer screen. 

Another problem with displaying DVD video on a computer via hardware or 
software comes in how the video is decoded. DVD video is actually made up of two 
distinct pieces of video: the video and the subpicture. The video holds the data which is 
normally a movie or show, such as a direct translation of a film. The subpicture may 
hold other pieces of information specially designed for the DVD. This commonly 
includes things such as menus, closed captioning text, subtitles, etc. The video is 
encoded according to the MPEG-2 standard. The subpicture is encoded using run length 
encoding. The subpicture is a rectangle which can be any size up to the size of the video, 
and is blended with the video at a specified location. 

Generally, a pixel of video information may be represented by RGB values (a 
value for each of the three primary colors - red, green, and blue) or by YUV values. A 
luminance value, denoted as Y, represents the brightness, or intensity, of a pixel. U and 
V are chrominance values, which together represent the color of a pixel in terms of hue 
and saturation. U and V are sometimes represented as C and C b . C b (representing blue 
information) is equal to B-Y and C r (representing red information) is equal to R-Y. The 
green value is not used in a separate color component since it can be derived by 
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subtracting the two difference signals from the Y signal. The YC b C r format is one type of 
YUV format, which generally refers to a form of color-difference video signal containing 
one luma and two chroma components. 

The DVD video is encoded as MPEG-2, which uses a 4:2:0 YC b C r component 
digital video format, indicating that there is one C b sample and one C r sample for every 
four Y samples. This also indicates that there is 2:1 horizontal downsampling and 2:1 
vertical downsampling for the chrominance samples in relation to the luminance samples. 

The subpicture video stream, however, uses a format equivalent to a 4:4:4 YC b C r 
digital video format, indicating that C b , C r , and Y are sampled equally and there is no 
downsampling of the chrominance samples. This results in more color resolution being 
available for the subpicture than the video stream. The subpicture stream also contains 
information on how to blend each subpicture pixel with the corresponding video pixel. 
The value which controls this blending is called the alpha value. 

When the DVD is played, the video data is blended with the subpicture data to 
produce a single image on the screen. In the past, DVD decoders generally decoded the 
MPEG-2 video data into a video surface as a 4:2:0 YC b C r format picture. Then, the 
subpicture was also decoded and converted to 4:2:0 YC b C r , then blended with the video 
by the DVD decoder, resulting in a loss of color resolution. Decoding the subpicture 
data, converting it to the primary surface color RGB format, then writing it directly into 
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the primary surface is generally not done because most primary surface color modes do 
not support an alpha value. Any RGB mode without an alpha value (24 bit or less 
primary surface) would require a fixed alpha to be used, thus dithering the data, which 
significantly reduces the quality of the subpicture data. This is due to the fact that the 
5 display pipeline (in the graphics chip) only knows how to read the video data in a single 
way for a particular primary surface color format. For example, if the primary surface is 
currently set to 24-bit RGB mode, the display pipe will be expecting data to be in an 8-8- 
8 format (8 bits for each of the red, green, and blue primary colors). It does not know 
how to handle any other format, and this format does not include an alpha component. 
lp Thus, the display pipe requires that the subpicture data be transformed into a format it can 
Co handle, resulting in the possible loss of subpicture resolution and a loss of the alpha 
« values. 

n What is needed is a solution which allows for the blending of DVD subpicture 

% 15 data with DVD video data and graphics information without losing subpicture color 
resolution. 

SUMMARY OF THE INVENTION 

20 A method an apparatus for rendering DVD subpicture data on a computer system 

having graphics data without a loss of subpicture resolution includes inserting a key into 
the subpicture data during or right after decoding and storing the subpicture data in the 
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primary graphics surface. This key indicates whether the data is graphics (GUI) 
information or subpicture information. The key is then examined by hardware logic in 
the graphics chip, allowing other hardware logic to blend DVD subpicture data with 
DVD video data without losing subpicture color resolution. The key may be 
implemented differently for different color modes of the primary surface, and may be 
unnecessary in certain modes. 



FIG. 1 is a block diagram illustrating the components traditionally used to blend 
video, subpicture, and graphics information on a computer monitor. 

FIG. 2 is a diagram illustrating how a color key may be used to combine graphics 
with video and subpicture. 

FIG. 3 is a block diagram illustrating this format of DVD subpicture data for a 
single pixel. 

FIG. 4 is a block diagram illustrating the organization of a presently preferred 
embodiment of the present invention. 



BRIEF DESCRIPTION OF THE DRAWINGS 
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FIG. 5 is a diagram illustrating a 32-bit chunk of data in 32-bit ARGB mode. 

FIG. 6 is a diagram illustrating a 24-bit chunk of data in 24-bit RGB mode. 

FIG. 7 is a diagram illustrating a 16-bit chunk of data in 16-bit RGB 565 mode. 

FIG. 8 is a diagram illustrating a 16-bit chunk of data in 16-bit 555 RGB mode. 

FIG. 9 is a flow diagram showing a method for rendering DVD subpicture data on 
a computer system having graphics information without a loss of subpicture resolution in 
accordance with a presently preferred embodiment of the present invention. 

FIG. 10 is a block diagram illustrating a DVD subpicture data renderer in 
accordance with a presently preferred embodiment of the present invention. 

DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT 

In the following description, a preferred embodiment of the invention is described 
with regard to preferred process steps and data structures. However, those skilled in the 
art will recognize, after perusal of this application, that embodiments of the invention 
may be implemented using at least one general purpose computer operating under 
program control, and that modification of the general purpose computer to implement the 
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components, process steps, and/or data structures described herein would not require 
undue invention. 

FIG. 1 is a block diagram illustrating the components traditionally used to blend 
5 video, subpicture, and graphics information on a computer monitor. DVD decoder 2, 
decodes the DVD information into video and subpicture information and blends them 
together. A graphics chip 4 receives the blended video and subpicture information in a 
video capture module 6. This blended video and subpicture information is then stored in 
memory 8, which contains a portion set aside solely for storing video data, also known as 
~tb the video surface 10. The video surface 10 now contains video blended with subpicture. 

£3 Graphics to be displayed on the computer screen are stored in a primary surface 12 

; ""5 

j\ in memory 8. When it is necessary to display the graphics, video, and subpicture 
n information on the computer monitor, a video engine 14 accesses the video surface 10 
□5 and then sends the blended video and subpicture information to an alpha blender 16. A 
graphics engine 18 does likewise with the graphics information. The alpha blender 16 
then combines the blended video and subpicture, with the graphics information on the 
computer screen. 

20 Pure software decoders work similarly, but write video and subpicture information 

directly into the video surface, bypassing the graphics chip 4 and capture module 6. 
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The primary surface may have many different formats. For 32-bit formats, ARGB 
is normally utilized which provides 8 bits for an alpha value, which represents the degree 
of transparency to be applied to a graphics pixel when combined with video or subpicture 
data. The alpha blender then uses this alpha field when blending the graphics with video 
5 or subpicture information. For formats less than 32-bit, a color key must be used. FIG. 2 
is a diagram illustrating how a color key may be used to combine graphics with video and 
subpicture. One color, for example magenta, is set aside to indicate a location that is to 
contain video and/or subpicture information rather than graphics information. Any 
?SB location on the screen, such as box 50, which contains that precise magenta color, will 
s "ft) then display video or subpicture information. The alpha blender performs this task of 
f □ combining the video or subpicture information into the correct portions of graphics 
L 3 information. 

fit 

fjjj DVD subpicture data can be stored without information loss such that 8 bits of 

E0 

%25 information are stored per pixel location. FIG. 3 is a diagram illustrating this format of 
DVD subpicture data for a single pixel. Four bits 102 contain the alpha, information on 
how to blend the color from the table with the video data, while four bits 104 contain an 
index to a color table indicating the color of the pixel. The alpha indicates the contrast or 
transparency level, with 0 being the subpicture is invisible and 15 being the subpicture is 

20 opaque. 
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The present invention provides a method and apparatus for blending subpicture 
data with video data using the primary surface in such a way that the subpicture color 
resolution and alpha values are not lost. How this works depends upon the current color 
mode of the primary surface. The invention will be described with relation to a primary 
surface of 32, 24, or 16-bit color resolution. However, one of ordinary skill in the art will 
recognize that other implementations are possible with other primary surface color 
resolution settings. Additionally, the preferred embodiment of the present invention is a 
combined software and hardware solution, however one of ordinary skill in the art will 
recognize that hardware only or software only embodiments of the present invention are 
also possible. 



FIGX4 is a block diagram illustrating the organization of a presently preferred 
: . embodiment of the present invention. A software translator 100 receives subpicture 
r5 information from a software DVD decoder 102, while video information is sent to video 
^35 surface 1 10 in memory 112. DVD decoder 102 would likely have been designed to 
combine separate video and subpicture streams since DVDs are encoded with separate 
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streams, so separating x out or requesting that the separate streams not be combined in the 
first place should not present a problem. To the extent that it does, however, an 
additional module may have to be placed after the DVD decoder 102 to separate out the 
subpicture and video streams. The present invention also assumes that the subpicture 
information received by the Software translator 100 is in the standard 4:4 format. To the 



extent that it is not, it must be translated into that format 
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IXfJS 0^^> The graphics chip 106 is also modified to include an alpha blender and subpicture 
overlay block \ 08 rather than simply an alpha blender. This is because the key 
potentially encoded into the stream by the software translator 100 needs to be encoded in 
5 some fashion. With a software DVD decoder 102, video capture module 104 may not 
have to be used. \The details of this operation will be described later in this document. 

It should be noted that the use of a software translator and hardware alpha blender 
and subpicture overlay block is only one possible embodiment of the present invention. 
"fO One of ordinary skill in the art would recognize that such functions could be performed 
[0 by hardware or software, and alternative placement of the blocks is possible. 

: s The software translator and hardware logic (or other device in the display pipeline) 

j§. are designed to utilize a key. The key is one or more bits that are transmitted with the 
\15 RGB data and signifies whether the data is graphics or is subpicture information. In 

some cases the key is unnecessary, but in the most common formats (16 and 24 bit RGB) 
it is. The challenge in utilizing the key is that the hardware driver is still set up only to 
receive data that has a specific size. For example, in 24-bit RGB, the video driver is still 
designed only to receive data in 24-bit chunks. Thus any key must be designed to work 
20 within that limitation. 
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For a 32-bit primary surface, a key is probably unnecessary. FIG. 5 is a diagram 
illustrating a 32-bit chunk of data in 32-bit ARGB mode. As FIG. 5 shows, 32-bit ARGB 
mode provides for an 8-bit alpha field. For the subpicture, the software translator may 
simply write the contrast/transparency level into this 8-bit alpha field and the full 
5 resolution color information into the 24-bit RGB field. This allows for he direct writing 
of the subpicture information into the primary surface, preserving subpicture resolution. 
At that point, the subpicture may be treated as part of the normal graphics, and thus alpha 
blending of the video data and graphics data may be performed normally. 

~'£b For a 24-bit primary surface, a 16-bit key is provided. FIG. 6 is a diagram 



illustrating a 24-bit chunk of data in 24-bit RGB mode. As FIG. 6 shows, in 24-bit RGB 
mode, video data has an 8-8-8 format (8 bits each for the red, green, and blue primary 



colors). The subpicture data is in the standard 4-4 format (4 bits for the alpha and 4 bits 
for the index). Thus the remaining 16 bits in the stream are open when subpicture data is 



k}5 stored in the primary surface. These 16 bits are used for the key. 

The rationale behind using as many bits as possible for the key is that by reserving 
the bit combinations to indicate whether the stream is graphics or subpicture data, there 
will be a loss in the number of possible colors available for graphics data. This is due to 
20 the fact that the 8-8-8 RGB format does not provide any space for a key, and therefore bit 
combinations usually used for certain colors will have to be reserved for the key. If the 
number of possible colors is going to decrease, it is beneficial to have it decrease as little 
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as possible. One 16-bit combination must be set aside to indicate that the data is 
subpicture information. This results in 256 possible colors being lost for the video data. 
Which 256 colors are lost are determined by which 16-bit combination is chosen for the 
key. For example, if the first 16-bits are chosen to represent the key and the bit 
5 combination representing subpicture is [00000000 00000001], this precludes every 
possible value for the "blue" primary color (the last 8 bits) when combined with this bit 
combination. Thus, the 24-bit value [00000000 00000001 ********] i s precluded from 
use in the video data, where * denotes either a 0 or a 1 . The value chosen for the key is 
usually a value that is not used very often and is dark. 



I a While this choice of bit combinations will work, any combination of bits can be 

□ chosen for the key. The specific bits which represent the key may be altered so as to 

f a achieve a more even distribution. For example, bits 0, 2, 4, 5, 6, 8, 10, 1 1, 12, 14, 15, 17, 

r i $ 

f§ 19, 20, 21, and 23 may be chosen to represent the key (five bits of red, six bits of green, 

L Li 

% J 5 five bits of blue). The bits used are usually chosen to make it easy for the software to 



manipulate the key and the subpicture data. The hardware logic in the display pipe must 
be designed to handle whatever bits are chosen for the key. 

For a 16-bit 565 video surface, an 8-bit key is used. FIG. 7 is a diagram 
20 illustrating a 16-bit chunk of data in 16-bit RGB 565 mode. As FIG. 7 shows, in 16-bit 
565 RGB mode, video data has a 5-6-5 format (5 bits for red, 6 bits for green, 5 bits for 
blue). The subpicture data is still in the standard 4-4 format (4 bits for the alpha and 4 
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bots for the index). Thus the remaining 8 bits in the stream are open when subpicture 
data is sent. These 8 bits are used for the key. 

One 8-bit combination must be set aside to indicate whether the data is subpicture 
5 information. This results in 256 possible colors being lost for the video data. Which 
colors are lost are determined by which 8-bit combination is chosen for the key. 

For a 16-bit 555 video surface, a 1-bit key is used. FIG. 8 is a diagram illustrating 
a 16-bit chunk of data in 16-bit 555 RGB mode. As FIG. 8 shows, in 16-bit 555 RGB 

h SET 

H§ mode, video data has a 1-5-5-5 format (1 empty bit, 5 bits for red, 5 bits for green, 5 bits 
I Q for red). The subpicture data is still in the standard 4-4 format (4 bits for the alpha and 4 
□ bots for the index). Thus the remaining 8 bits in the stream are open when subpicture 
5 data is sent. However, since there is one unused bit in the video data, this bit is used as 

the key. This allows a solution without the loss of any color information in the video 
3 5 data. 

SB. 

FIG. 9 is a flow diagram showing a method for rendering DVD subpicture data on 
a computer system having graphics information without a loss of subpicture resolution in 
accordance with a presently preferred embodiment of the present invention. At 200, a 
20 key is inserted into the subpicture data to indicate that the data is subpicture information. 
Then, at 202, the subpicture data is written to a primary surface, the primary surface also 
receiving the graphics data. At 204, the data is read out of the primary surface. 
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At 206, it is determined if the data read out of the primary surface is subpicture 
data or graphics data by looking for the key in the data. If the key exists, the data is 
subpicture data, and the method moves to 208, where the subpicture data is converted to 
5 an RGB value and an alpha value and the RGB value is blended with DVD video data 
according to the alpha value. If the data is graphics data, at 210 it is combined with DVD 
video data. This may require use of a color key if there is no alpha provided. 

FIG. 10 is a block diagram illustrating a DVD subpicture data renderer in 

*lb accordance with a presently preferred embodiment of the present invention. Since 

in 

f □ portions of the renderer may be implemented in hardware and portions in software, the 

□ different blocks and components will be discussed and pictured abstractly. 

3 

fii 

r § A key inserter 250 takes subpicture data and inserts a key to indicate that the data 

k§5 is subpicture information. Then, a subpicture data writer 252 writes the subpicture data 
to a primary surface 254. A primary surface reader 256 reads the data out of the primary 
surface. Video data is stored in the video surface 258 and read out by video surface 
reader 260. 

20 The hardware components (the graphics chip in a presently preferred embodiment 

of the present invention) must be designed to correctly interpret the key (if any). Thus, A 
subpicture key select block 262 is preprogrammed to select specific bits that are used to 
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hold the key, the key indicating whether the data is subpicture or graphics information. A 
subpicture detect block 264, which may be simply a comparator, looks for a match to the 
subpicture key and indicating whether it is indeed a match. Alpha select block 266 
selects the appropriate bits for the alpha, depending on the data format, while index select 
5 block 268 selects the appropriate bits for the index, again depending on the data format. 
Subpicture Palette 270 is a 16 x 24 bit look up table for translating the color information. 

A color and chroma key detect block 272 is used if the data format is less than 32 
bits, and thus there is no alpha field, because, as described earlier, it would be necessary 



HO to set aside a color to indicate pixels which are to be used to display video rather than 

I Q graphics. Multiplexor 274 utilizes all this information and outputs an alpha value to the 

□ alpha blender 276, which then uses the alpha value to blend the graphics/subpicture 

5 information with the video information. 



described, it would be apparent to those skilled in the art having the benefit of this 
disclosure that many more modifications than mentioned above are possible without 
departing from the inventive concepts herein. The invention, therefore, is not to be 
restricted except in the spirit of the appended claims. 




While embodiments and applications of this invention have been shown and 
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